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REMARKS 



Claims 1-14 have been canceled. New claims 15-33 have been added. Thus, claims 
15-33 are presented for examination. Applicant respectfully requests allowance of the present 
application in view of the foregoing amendments. 



A substitute specification incorporating the changes in this preliminary amendment is 
provided with this application. No new matter has been added by way of the substitute 
specification. 



Conclusion 

The commissioner is hereby authorized to charge any appropriate fees due in 
connection with this paper, including the fees specified in 37 C.F.R. §§1.16 (c), 1.17(a)(1) and 
1.20(d), or credit any overpayments to Deposit Account No. 19-2179. 



The amendments are not made for purposes of patentability. 



RespectfiiUy submitted, 





JohnPf Musone 
Registration No. 44,961 
(407) 736-6449 



Siemens Corporation 
Intellectual Property Department 
170 Wood Avenue South 
Iselin, New Jersey 08830 



2003P07069WOUS Preliminary Amendment JDH.rtf 
9 of 9 



[0001]Doooription 



Attorney Docket No. 2003P07069WOUS 

IAP29KS3';;:37;:73 15 DEC 20(0 



DEVICE FOR THE TEMPORAL COMPRESSION OR EXPANSION, 
ASSOCIATED METHOD AND SEQUENCE OF SAMPLES 

CROSS REFERENCE TO RELATED APPLICATIONS 

[00011 This application is the US National Stage of International Application No. 
PCT/EP2004/050617. filed April 27, 2004 and claims the benefit thereof. The 
International Application claims the benefits of German application No. 10327057.4 DE 
filed June 16, 2003, both of the applications are incorporated by reference herein in their 
entirety. 

FIELD OF INVENTION 

[0002] The device contains an input memory in which samples to be processed are 
stored, and a control unit, which controls a temporal expansion or compression of the 
sequence of samples in a cyclic manner based on a conversion factor. 

BACKGROUND OF INVENTION 

[0003] One such device is for example well known from DE 100 06 245 AL In 
addition to the conversion method mentioned in said document for time scaling, in the 
past 50 years, numerous other methods have been proposed. However, with respect to a 
compromise between the required computer capacity and the quality achieved, extremely 
few of these methods are satisfactory. In particular, methods with Fourier transformation 
or the calculation of cross correlations are computer-intensive. Other methods are indeed 
very simple, but lead to audible artifacts. 

[0004] With time-scale conversion devices, audio data can be converted in such a 
way that the time duration of the audio signals represented by the audio data changes 
while extensively maintaining its tone pitch. A plurality of methods for the conversion of 
the time scale, for the time being, carries out an analysis of the audio data in order to 
determine the parameters. Processing only starts after the analysis has been implemented. 
The analysis is carried out in a time window, the span of which orients itself to the 
characteristics of human hearing and even to the voice characteristics, i.e. in a time 
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window in the order of magnitude of a few hundredth seconds, for example, in a time 
window between 20 and 40 ms (milliseconds), in particular 30 ms. The analysis also 
delays the audio flow to be converted, so that the speech quality, in particular with 
respect to the occurrence of audible echoes, is reduced. As a result, the advantage of the 
time-scale conversion device is often smaller than the disadvantages associated with it. 
This statement in particular applies to the synchronization of the sampling rate by means 
of time-scale conversion devices in the case of a mismatching of the pulse of the 
conmiunicating devices in a data transmission network. However, the mismatching is 
mostly negligible and is usually less than 10 percent; however, the delay generated by the 
conversion is audible for a speaker. 

SUMMARY OF INVENTION 

f0006t [00051 An T be-obi ect of the invention is to create a simply constructed device for 
compression and/or expansion of the time scale of the sequence of samples. The device 
should in particular be suitable for expansions or compressions by less than 10 percent. 
The expansion or compression should also not reduce the quality of voice signals or 
music signals. The device should in particular operate without an analysis of the audio 
data in order not to delay a real time processing any ftirther. In addition, both a method 
for compression and expansion and a sequence of samples should be given. 

[0006]Th e obj e ct of this inv e ntion is solv e d by a devic e with th e featur e s giv e n in claim 
1 . Further dev e lopm e nts ar e d e fin e d in th e subclaims. 

fOQO?tf00061 The device in accordance with the invention, in addition to the above- 
mentioned units, also contains the following: 

- a skew unit that is linked on the input side to the output of the input memory 
and that, referred to the sample processed in one working step of the sequence, 
determines a sample by an offset number that follows, i.e. delayed, or precedes 
in the sequence by an offset number, 

- a merge unit which, on the one hand, merges a filtered sequence of samples 
that have been generated from the original sequence of samples by means of a 



2003P07069WOUS Marked Up JDH.rtf 
2 of 13 



Attorney Docket No. 2003P07069WOUS 

filter unit with a time-staggered sequence that has been generated with the aid of 

the skew unit and subsequently filtered on the other hand. 
tQ0081f00071 I n addition, a device in accordance with the invention contains a working 
cycle of a predetermined number of working steps for processing a sub-sequence of the 

sequence of samples. Because of this, the length of a working cycle need not be 
determined anew continuously. 

f0009tf00081 T herefore, the device in accordance with the invention makes do without 
an analysis window and is in this way suitable for all the applications of conversion 
devices, in particular, for real time applications such as real time commxmication. In 
particular, the device for the synchronization of the sampling rate of the audio data of 
packet-oriented terminals is suitable, for example, of Intemet terminals, which operate in 
accordance with the Intemet protocol. 

fOMOI[00091 In the case of other further developments, the device contains only 
coefficient default units, multiplication units and delay units, i.e. only a few different 
units that can be implemented in an easy manner via wiring or software. 

fWH4f00101 In the case of additional further developments of the device, the voice 
quality is fiuther increased by: 

- the inclusion of additional coefficient fimctions, auxiliary functions and 
additional delay units, or by 

- the inclusion of an all-pass. 

f00t3tf00111 I n the next fiirther development, the device is constructed as a pure 
electronic circuit without a processor. In this case, the processing times compared with 
the processing times when including a processor are very short. However, as an 
alternative a processor is used in order to reduce the circuitry involved. 

fOM-3t[00121 I n addition, the invention concerns a method for the temporal compression 
and expansion, which in particular can be embodied with the device in accordance with 
the invention or one of its fiirther developments. In this way, the above-mentioned 
technical actions also apply to the method and its fiirther developments. 

f00t4tf00131 I n addition, the invention also relates to a sequence of samples which have 
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been generated with the device in accordance with the invention or the method in 
accordance with the invention. The above-mentioned technical actions also apply to the 
sequence of samples. 

BRIEF DESCRIPTION OF THE DRAWINGS 

fOOt5tf00141 T he invention is explained in detail below with reference to the 
accompanying drawings and on the basis of the embodiments. They are as follows: 

Figure 1 a block diagram of a conversion device, 
Figure 2 a conversion device with one delay unit, 
Figure 3 a conversion device with two delay units, 
Figure 4 a conversion device with a delay xmit and an all-pass, and 
Figure 5 the transmission functions for the overlapping and addition function of the 
different conversion units. 



DETAILED DESCRIPTION OF INVENTION 

fOOj^FOOlS] Figure 1 shows a block diagram of a conversion device 10, which is used 
for the temporal expansion or the temporal compression of voice signals. In other words, 
by using the conversion device 10, the playback speed may vary from voice data to real 
time, without for example the tone pitch of the voice signal changing in any way. There 
are also no audible artifacts, 

fOM:?tf00161 T he conversion device 10 has an input 12 for entering the samples of a 
voice signal, which has for example been sampled with a frequency of eight kilohertz. 
The samples are, for example, in the integral range between -32768 and +32767. The 
input 12 leads to a filter unit 14, which for the input values or for the time-staggered input 
values carries out filter functions in accordance with the predetermined coefficients. The 
coefficients change time-dependent so that a filtering varying in time is present. 

f00j^[00171 A n overlapping and addition unit 16 is connected downstream of the filter 
unit 14 which merges two sequences of samples output by the filter unit 14, which will be 
explained in greater detail below. The overlapping and addition unit outputs a sequence 
of results at an output 1 8. 
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f003^f00181 In addition, the conversion device 10 contains a control unit 20, which 
based on a conversion factor N and a selection signal, activates the filter unit and the 
overlapping and addition unit in such a way that the sequence of samples at the output 1 8 
is temporally stretched or temporally compressed in comparison with the sequence at the 
input 12. In this case, N is a natural number. 

f0030tf00191 I n the case of another embodiment, the filter unit of the overlapping and 
addition unit is connected downstream in such a way that first a non-delayed sequence 
and then a delayed sequence are overlapped. Only after the overlapping, artifacts 
generated by the overlapping are cleared again for example with a suitable window 
fiinction or with a time- variant attenuator. 

{00244100201 F igure 2 shows a conversion device 100, which contains a memory unit 
102, for example, a RAM memory (Random Access Memory) or a FIFO memory (First 
In First Out). The memory unit 102 contains an input memory 104, in which arriving 
samples are stored intermediately. 

f0023tf00211 Furthermore, the conversion unit 100 contains a delay unit 106 which, 
referred to a sample to be processed in a working step s, determines a sample fi:om the 
memory unit which has been delayed by N samples to the sample actually to be 

processed. The delay can be implemented by means of the suitable reading out of the 
memory unit 102, for example by an address offset by N or a multiple of N. 

{003^100221 In addition, the conversion device 100 contains a multiplication imit 108, 
which is linked to the output of the input memory 108. The other input of the 
multiplication unit 108 is linked to a coefficient default unit, which specifies coefficients 
in accordance with a coefficient function CI a. The multiplication unit 108 calculates the 
product of their input values in each working step s. 

I0034H00231 A n additional multiplication unit 1 10 is linked on the input side to the 
output of the delay unit 106 and the coefficient default unit, which specifies coefficients 
in accordance with a coefficient default function C2a. The course of the coefficient 
fiinctions Cla and C2a is shown in the center part of Figure 2 for the expansion or in the 
lower part of Figure 2 for the compression and is explained in detail fiirther below. The 
multiplication unit 110 calculates the product of their input values for each working step. 
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f003St[00241 An addition unit 1 12 is linked on the input side to the outputs of the 
muhiplication units 108 and 110. The addition unit 112 calculates the sum of their input 
values. 

f0036t[002S1 The course of the coefficient functions CI a and C2a for the expansion is 
shown in the center part of Figure 2. The values of the coefficient functions Cla and C2a 
are between 0 and 1 . At first, the coefficient Cla constantly has the value 1 . Only in the 
last section, more precisely in the last third of a working cycle M of for example 1600 
working steps s, the coefficient function Cla is strictly monotone, for example, as shown 
in accordance with a function, which is similar to the sigmoid function or also in a linear 
manner. On the other hand, the coefficient C2a on expansion then constantly at first has 
the value 0. Only in the last section the coefficient function C2a increases strictly 
monotone, for example, as shown in accordance with a function, which is similar to a 
sigmoid function or even in a linear manner. 

t003^f00261 This means that in the first section of a working cycle M, on expansion, 
the non-delayed sequence of samples is output. In the last section there is then a gradual 
changeover to the delayed sequence because of the coefficient courses. The gradual 
transition then spreads out over a plurality of working steps s, in particular over more 
than 100 working steps s and less than 800 working steps s. Expressed more in general, 
the transition is in a section, which contains more than five percent and less than fifty 
percent of the working steps of a working cycle. Finally, for expansion an "echo" is 
appended that is, however, on account of the gradual transition because of the too short 
time span, which the samples of a working cycle M contain and on account of the 
moderate expansion factors not audible or only faintly audible. In the embodiment, a 
working cycle referred to the processed values comprises more than 200 ms 
(milliseconds) and less than 1000 ms. It is expanded 10 percent max. In this way, at least 
six basic voice units of approximately 30 ms are in each case processed in a working 
cycle M. 

W028tr00271 T he course of the coefficient functions Cla and C2a for the compression is 
shown in the bottom part of Figure 2. The values of the coefficient functions Cla and 
C2a are again between 0 and 1 . At first, the coefficient C2a constantly has the value 1 . 
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Only in the last section, more precisely in the last third of a working cycle M the 
coefficient function C2a is strictly monotone, for example, as shown in accordance with a 
function, which is similar to the sigmoid function or also in a linear manner. On the other 
hand, the coefficient CI a on expansion then constantly at first has the value 0. Only in the 
last section the coefficient function CI a increases strictly monotone, for example, as 
shown in accordance with a function, which is similar to a sigmoid function or even in a 
linear maimer. 

f0029tf00281 T his means that in the first section of a working cycle M, the delayed 
sequence of samples is output when a compression is implemented. In the last section, 
because of the coefficient courses, there is a gradual switching over to the non-delayed 
sequence. Finally, for compression a part of the samples is "suppressed". However, based 
on the above-mentioned reasons this is only faintly audible. Because of the gradual 
transition, the "suppressed" samples also have an effect on the generated output signal. 

f0030tl00291 For the coefficient functions Cla and C2a, the following relation also 
applies: 

(Cla)^ + (C2a)^=l, 

in which case the signal power of the voice signals and the music signals remains 
unchanged on average and in essence. 

fOOMt[00301 Figure 3 shows a conversion device 200 with two delay units 206 and 207. 
A first part of the conversion unit 200 corresponds structurally and in accordance with its 
function to the conversion device 100. Because of this, the elements of this part are not 
explained again and in Figure 3 have the same reference symbols as in Figure 2, but in 
each case increased by the value 100. However, instead of the coefficient function Cla or 
C2a, the coefficient functions Clb and C2b whose course is explained in detail below are 
used. 

f00^[00311 Unlike the conversion device 100, the conversion device 200 still contains 
an additional delay unit 207, however delayed by double as the delay unit 106 or 206, i.e. 
by 2 * N. The input of the delay imit 207 is linked to the output of the input memory 204. 
The output of the delay unit 207 is linked to the input of a multiplication unit 211. The 
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other input of the muhipHcation unit 21 1 is linked to a coefficient default unit, which 
specifies the coefficients in accordance with a coefficient function C3b whose course is 
explained in detail below. 

f00^f00321 T he input of the addition unit 212 is linked to both the outputs of the 
multiplication unit 208 and 208 and the output of the multiplication unit 211. The 
expanded or compressed sequence of samples is output at the output of the addition vmit 
212. 

fOOMH0033] The course of the coefficient function Clb and two auxiliary functions 
C2c and C3c is shown in the center part of Figure 3 for expansion and in the lower part of 
Figure 3 for compression. The course of the coefficient function Clb corresponds to the 
course of the coefficient function CI a, see explanations to Figure 2. The course of the 
auxiliary function C2c for expansion and compression in each case corresponds to the 
course of the coefficient function C2a for expansion and compression, see explanations to 
Figure 2. The auxiliary function C3c in the first two thirds of a working cycle M has the 
value 0. In the last third, the auxiliary function C3c increases strictly monotone to a 
maximum value of approximately 0.3, then to decrease again strictly monotone to the 
value 0. The auxiliary function C3c has its maximum in a working step s, in which the 
coefficient function Clb has the same value as the auxiliary function C2c. 

f0035tf00341 F or the coefficient functions C2b and C3b, the following applies: 

C2b = C2c-C3c*Clb, 
C3b - - C2c *C3c. 

t0036t[003S] I n the case of another embodiment, the following relations also apply: 

(Clb)^ + (C2c)^=L 
(Clb) + (C2b) + (C3b)=l, 

in which case the signal power of the voice signals and the music signals remains 
unchanged on average and in essence and specific tones likewise also remain xmchanged, 
for example tones with a gyrofrequency of 2 PI k/N, in which case the PI, the number PI 
and k are a natural number. 

f003?tf00361 The conversion device 200 can also be shown in an equivalent maimer by 
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using two parallel switched equalizers in accordance with the conversion device 100. The 
input of the one equalizer branch is linked to the output of the input memory 204, The 
equalizer is controlled with the coefficient functions Clb and C2c. The input of the other 
equalizer branch is likewise linked to the output of the input memory 204. The second 
equalizer branch contains a parallel connection from an additional delay unit for a delay 
N and from an equalizer unit in accordance with the conversion device 100. The second 
equalizer is likewise controlled with the coefficient functions Clb and C2c. In addition, 
the second equalizer branch contains a multiplication unit where the coefficient function 
C3c is present at its other input. Both equalizer branches are linked via a balancing circuit 
in which case the result of the second equalizer branch is deducted from the result of the 
first equalizer branch in each working step s. 

f0038tf00371 Improved results are achieved by the conversion device shown in Figure 3, 
which is explained in detail in association with Figure 5. In particular, a type of notch 
filter with smaller frequency gaps compared with the conversion device 100 is developed. 
These results can further be improved in a similar way by introducing additional delay 
units and coefficients. 

f0039tf0038] F igure 4 shows a conversion device 300 with a delay unit 306 and an all- 
pass 320 of the first order and a first part of the conversion device 300 is constructed in 
the same way as the conversion device 100 and also functions in the same way. Because 
of this, the elements of this part are not explained again and in Figure 4 have a reference 
symbol to which, taking the reference symbol in Figure 2 as a starting basis, the value 
200 has been added. However, in the place of the coefficient functions Cla and C2a the 
coefficient functions Cld and C3d are used whose course is explained in greater detail 
below. 

f0040t[00391 Unlike the conversion device 100, the conversion device 300 also contains 
the all-pass unit 320. The all-pass unit 320 contains a filter unit 322 and a delay unit 324, 
which is delayed by N steps. The all-pass unit 320 has the following transmission 
function: 

H = (z"^-f Y)/(l+y*z^), 
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in which case H is the transmission function, y determines a delay and y in particular has 
the value 0.5 or a value exceeding 0.5. 

100414100401 T he input of the all-pass unit 320 is linked to tiie output of the input 
memory 304. The output of the all-pass unit 320 leads to the one input of a multiplication 
unit 311. The other input of the multiplication unit 3 1 1 is linked to the output of a 
coefficient default unit, which for each working step s specifies coefficients in 
accordance with a coefficient default function C2d whose course for the two operating 
modes "expansion" and "compression" will still be explained in greater detail. 

f0042tf00411 The output of the multiplication unit 311 leads to an input of the addition 
unit 312. The other inputs of the addition unit 1 12 are linked to the outputs of the 
multiplication units 308 and 310. 

f004^f00421 The values of the coefficient functions Cld, C2d and C3d lie between 0 
and 1. The following applies to the coefficient functions Cld to C3d: 

Cld + C2d + C3d=l 

in which case specific tones likewise remain unchanged, for example, tones of a 
gyrofrequency of 2 PI k/N, in which case the PI, the number PI and k are a natural 
number. 

{0044H00431 In the operating mode "expansion", the coefficient function Cld, in the 
first third of a working cycle, decreases strictly monotone from the value 1 to the value 0, 
for example, in accordance with a function, which is similar to or the same as a sigmoid 
function. For the following working steps s of the working cycle M, the coefficient 
function Cld remains at the value 0. In the operating mode "expansion", the coefficient 
function C2d increases in the first third of a working cycle M from the value 0 to the 
value 1. In the second third, the coefficient function C2d constantly remains at the value 
1. In the last third, the coefficient function decreases strictly monotone firom the value 1 
to the value 0. In the operating mode "expansion", the coefficient function C3d in the first 
two thirds of a working cycle M constantly remains at the value 0. In the last third of a 
working cycle M, the coefficient function C3d increases strictly monotone firom the value 
0 to the value 1. 

2003P07069WOUS Marked Up JDH.rtf 
10 of 13 



Attorney Docket No. 2003P07069WOUS 



fO045t[00441 F or the operating mode "compression", the coefficient function Cld has 
the course of the coefficient function C3d in the operating mode "expansion". The 
coefficient function C2d, in the operating mode "compression" has the same course as in 
the operating mode "expansion". The coefficient function CSd, in the operating mode 
"compression" has the same course as the coefficient function Cld in the operating mode 
"expansion". 

f0046t[00451 F igure 5 shows the transmission functions for the overlapping and addition 
function of different conversion units at places where there are frequency gaps. A 
horizontal x-axis 400 shows the normalized frequency in the range between 0 and 0.5. 
The course shown in Figure 5 repeats itself for higher frequencies. A vertical y-axis 402 
shows the normalized attenuation in dB in the range from -5 dB to 20 dB. A curve Kl 
applies to the conversion device 100, which can also be considered as the equalizer of the 
zeroth order. The conversion device 200 can be regarded as the equalizer unit of the first 
order. A curve K2 applies to the conversion device 200. With an increasing order of the 
equalizer, the attenuation decreases. In addition, a frequency gap LI to L2, which applies 
to the curve Kl or K2 becomes smaller. 

f004?t[00461 Curves K3 and K4 apply to the conversion device 300 with a y value of 
0.5 or 0.75. With an increasing y value, the frequency gap decreases further. 

f0048tf00471 The conversion factor N, which specifies the number of delays, is for 
example specified depending on the occupancy of the input memory 104, 204 or 304. The 
same applies to the decision whether or not an expansion or a compression should be 
implemented. If the input memory for example empties too quickly, an expansion must 
be implemented. The quicker the input memory is emptied, the quicker an expansion has 
to be carried out, i.e. N is enlarged. 

I0049tf00481 For all the explained embodiments it is applicable that the invention uses 
characteristics pertaining to human hearing, in accordance with which special types of 
artifacts cannot be distinguished or can only faintly be distinguished, in particular said 
artifacts which develop by using the above-mentioned overlapping method. The method 
operates in the time range with the aid of a fixed time frame, which divides the audio data 
into time segments, for example, into time segments of 200 ms. In order to convert the 
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time scale, the original audio flow with a delayed version of its own is overlapped and 
added within a time segment in a section with a defined length for example of 30 ms. 
This takes place on the basis of selected coefficients so that no discontinuity develops. 
The delay is proportional to the conversion factor and corresponds to the delay between 
the audio flow at the input and output of the time-scale conversion device. The delay is 
for example between 0 ms and 20 ms in the case of a conversion factor from 0 percent up 
to 10 percent in the sense of time compression or time expansion. The selection of the 
above-mentioned time frame or time segment section likewise contributes to reducing the 
ability to distinguish the developing artifacts. 

f0050tf00491 In the explained methods, the development of artifacts or audible 
interferences has already been counteracted and/or removed on merging the developing 
artifacts after the merging, for example, with a time-variant attenuator, which does not 
further increase the overall delay of the conversion device. A more costly digital filter 
leads to an improved quality, but usually increases the overall delay somewhat. 

WO^rOOSOl The explained methods: 

are oriented to the characteristics of human hearing and make do without an 
analysis window, 

can be introduced with small algorithmic delay times into the audio path, 

can be implemented in a cost-effective manner, 

can be used in real time applications on account of the small delays, 

make possible a high-quality conversion both from voice and from music, 

can be used in a plurality of applications, for example, for the synchronization 

of the sampling rate or for a dynamic jitter buffer adjustment, 

can be combined with other time-based methods, for example, with the method 

in accordance with "MPEG-4 Audio, ISO/IEC FCD 14496-3, Subpart 1 : 

Section 4.1.3" dated 15.05.1998, see, for example ftp://ftp.tnt.uni- 

haimover.de/pub/MPEG/ audio/mpeg4/documents/w2203/w2203.pdf 

f0053t[00511 In the case of altemative embodiments in accordance with Figures 2 and 3, 
the overlapping and addition ranges are not located at the, but at the beginning of a 
working cycle M, so that at the of a working cycle M there are then sections with 
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constant coefficient functions and with constant auxiliary functions. In the case of other 
alternative embodiments in accordance with Figures 2 and 3, the overlapping and 
addition ranges are located in the center of a working cycle M so that at the of a working 
cycle M and at the beginning of a working cycle M there are then sections with constant 
coefficient functions and constant auxiliary functions. 

f00S3^[00521 I n the case of alternative embodiments in accordance with Figure 4, in 
addition to the two overlapping and addition sections with changing coefficient functions 
and auxiliary fiinctions there are also two constant sections. Each section is for example 

one quarter of a working cycle M in length. Altematively, sections with different lengths 
can also be used. If the overlapping and addition sections are abbreviated with an U and 
the constant sections with a K, this for example results in the following section sequences 
for each working cycle M: 

CF-K-U-K, or 
K - U - K - U, 

in which case the temporal sequence of the sections shown in Figure 4 on compression or 
expansion is retained. 
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